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The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .1 36 (a). In no event, however, may a reply be timely filed 

after SIX (6) MONTHS from the mailing date of this communication. 

- if the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will 

be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this 

communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Status 

1 )□ Responsive to communication(s) filed on 12 November 1998 . 
2a)D This action is FINAL. 2b)S This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 1-39 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) S Claim(s) 1-39 is/are rejected. 

7) 0 Claim(s) is/are objected to. 

8) D Claims are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are objected to by the Examiner. 

11) D The proposed drawing correction filed on is: a)d approved b)D disapproved. 

12) D The oath or declaration is objected to by the Examiner. 

Priority under 35 U.S.C. § 119 

13) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d). 

a)D All b)D Some * c)D None of the CERTIFIED copies of the priority documents have been: 
received. 

2.Q received in Application No. (Series Code / Serial Number) . 

3-D received in this National Stage application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) Q Acknowledgement is made of a claim for domestic priority under 35 U.S.C. & 1 19(e). 



Attachment(s) 

15) S Notice of References Cited (PTO-892) 

16) Q Notice of Draftsperson's Patent Drawing Review (PTO-948) 

17) O Information Disclosure Statement(s) (PTO-1449) Paper No(s) . 



18) O Interview Summary (PTO-413) Paper No(s). 

19) □ Notice of Informal Patent Application (PTO-152) 

20) □ Other: 
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DETAILED ACTION 
Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

1. Claims 1-3, 6, 9-10, 13, 16-19, 21-28, 31, 33-34, 36, and 38 are rejected under 35 
U.S.C. 103(a) as being unpatentable over French St. George et al. (US Patent No. 6,018,71 1) in 
view of French St. George et al. (US Patent 6,012,030) 

2. Regarding claims 1,9, 13, 16-19, 21, 22, 23, 25-27, 33, 34, 38 "speech recognition 
engine to recognize an utterance... listen for the utterance for a predetermined response time..." is 
taught by St. George 6 71 1 at col 6, lines 9-67 continuing to col. 9, lines 1-19; 

"...user interface configured to play an audible sound indicating recognition of the 
utterance and to display a countdown graphic that changes with lapsing of the response time" is 
taught by St. George '71 1 at col. 6, lines 9-67 continuing to col. 9, lines 1-19; 

St. George '71 1 does not teach "a user interface to provide visual and auditory feedback 
indicating whether the speech recognition engine recognizes the utterance". However, 
refer to St. George '030 who teach management of speech and audio prompts in multimodal 
interfaces with specific use with a speech interface for use with a speech recognizer. Refer to 
col.8, lines 23-67 continuing to col. 10, lines 1-67 where they teach providing feedback to the 
user of a speech recognition system. 
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Therefore, it would have been obvious to one of ordinary skill at the time of the invention to 
modify the user interface for a speech recognition system of St George '71 1 to implement 
providing feedback to the user of a speech recognition system as taught by St. George '030 
because such a modification would ensure the user the recognition system was functioning 
properly and that the system vocabulary was current. 

St. George '711 teach that their system interface is applicable or usable in a plurality of 
networks, systems, communication devices, terminals and platforms (see col. 6, lines 9-16, and 
col. 9, lines 3-18). 

3. Regarding claims 2, 10, 28, and 36, neither St. George '71 1 nor St. George '030 teach the 
"user interface restarts countdown graphic in the event the speech recognition engine recognizes 
the utterance." However, it would have been obvious to modify the user interface system of St. 
George '71 1 to implement visual and auditory feedback as taught by St. George '030, and to 
further modify the system to allow for the user interface restarting the countdown graphic, 
because such a modification would continually grant the user the maximum response time for 
generating an utterance to be recognized, which would improve the usability and flexibility of 
the system. 



4. Regarding claim 3, "..response time is configurable.." is taught by St. George '711 at col. 
7, lines 9-21. 
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5. Regarding claims 6, 14, 24, 3 1, and 39, "...user interface plays sound when the response 
time has elapsed" is taught by St. George '711 at col. 8, line 67 continuing to col. 9, lines 1-3. 

Claims 4-5, 7-8, 11-12, 15, 20, 29-30, 32, 35, and 37 are rejected under 35 U.S.C. 103(a) 
as being unpatentable over French St. George et al. (US Patent No. 6,018,71 1) in view of French 
St. George et al. (US Patent 6,012,030) as applied to claims 1, 9, 18, 23, 27 and 34 above, and 
further in view of VanBuskirk et al. (US Patent No. 6,075,534). 

6. Regarding claims 4, 1 1, 20, 29, and 37, neither St. George '71 1 nor St. George '030 teach 
"...interface displays visual elements in a first color..." However, refer to VanBuskirk et al. Who 
teach a user interface for a speech recognition system which implements a minibar graphic that is 
used to provide status information of the functions of the recognition system via changing of the 
color of the graphic or a moving ribbon (refer to Figures 1 A-7 and col. 4, lines 12-33). 

Therefore, it would have been obvious to one of ordinary skill to modify the speech 
recognition user interface of St. George to implement the changing of the graphic color of 
VanBuskirk et al., for the purpose of providing the user with more options in how they can 
monitor utterance input response time. 

7. Regarding claims 5, 12, 30, and 35, "...countdown bar comprises a progress bar.." neither 
St. George '71 1 nor St. George '030 teach "...countdown bar comprises a progress bar..." 
However, refer to VanBuskirk et al. Who teach a user interface for a speech recognition system 
which implements a minibar graphic that is used to provide status information of the functions of 
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the recognition system via changing of the color of the graphic or a moving ribbon (refer to 
Figures 1A-7 and col. 4, lines 12-33). 

Therefore, it would have been obvious to one of ordinary skill to modify the speech 
recognition user interface of St. George to implement moving ribbon (applicant's progress bar) 
of VanBuskirk et al., for the purpose of providing the user with more options in how they can 
monitor utterance input response time. 

8. Regarding claims 7, 15, 32, neither St. George '71 1 nor St. George '030 teach "...sleep 
mode... awakened to an active mode upon detection of starter utterance" However, refer to 
VanBuskirk et al. Who teach a user interface for a speech recognition system which implements 
a minibar graphic that is used to provide status information of the functions of the recognition 
system via indicating that the system is in sleep mode and can be awakened by either saying a 
proper command or by manual means (refer to col. 4, lines 42-5 1 . 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the user interface of St. George to implement the sleep/awaken methods of 
VanBuskirk et al., for the purpose of ensuring the user's utterance is captured in a hands-busy 
environment. 

9. Regarding claims 8 neither St. George '71 1 nor St. George '030 teach "...sleep 

mode.. .awakened to an active mode upon depression of a button". However, refer to VanBuskirk 
et al. Who teach a user interface for a speech recognition system which implements a minibar 
graphic that is used to provide status information of the functions of the recognition system via 
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indicating that the system is in sleep mode and can be awakened by either saying a proper 
command or by manual means (refer to col. 4, lines 42-5 1 . 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the user interface of St. George to implement the sleep/awaken methods of 
VanBuskirk et al., for the purpose of providing the user with more control over when the system 
is activated and to safeguard against the system responding to extraneous noise. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Angela A. Armstrong whose telephone number is 703-308-6258. 
The examiner can normally be reached on Monday-Thursday 7:30-5:00 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David R. Hudspeth can be reached on 703-308-4825. The fax phone numbers for the 
organization where this application or proceeding is assigned are 703-308-6306 for regular 
communications and 703-308-6296 for After Final communications. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is 703-305-3900. 



AAA 

July 3, 2000 




Richemond Dorv» 
Primary Examiner 



